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[57] ABSTRACT 

A tri-sensor track association based on ranked candidate 
pairs and measures of their proximity is described. The 
track association employs a three dimensional assign- 
ment scheme, simple enough to be implemented in real- 
time, which preserves the most accurate pairwisc links 
of the highest ranked pairs, requires at least two pair- 
wisc links for any tri-scnsor global track association, 
and minimizes the time average statistical bearing dis- 
placement between associated tracks. 
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The ownship multi-sensor integration may also be 
AUTOMATIC GLOBAL RADAR/IR/ESM TRACK dictated by the need to support new or multiple weapon 
ASSOCIATION BASED ON RANKED CANDIDATE systems. Successful designation of a target to a weapon 
PAIRINGS AND MEASURES OF THEIR system whose main guidance is based on radio frc- 

PROXIMITY 5 quency emissions may only be performed if that target 

is known to be actively emitting. 
BACKGROUND OF THE INVENTION When multiple targets are tracked by multiple own- 

The present invention relates to multiple sensor inte- **^P s«nsors, the number of tracks generated by each 
gration (MSI), multiple sensor tracking (MST). and ^B^t could be as high as the number of sensors, and 
more particularly to the association of tracks generated ^ presence of numerous targets it becomes, 

by three collocated disamilar sensor systems: radar, imperative to generate and maintain a coherent tactical 
infrared (IR), and electronic support measures (ESM). picture of the environment, in which each target is 

Radar Systems arc commonly used to detect and represented by a unique global track. In a dense envi- 
track targets. Such a radar system includes a radar sen- ronment, an accurate Uctical picture free of rcdundan- 
sor and a computer. The radar sensor radiates electro- cics, conflicts and ambiguities can only be obtained by 
magnetic energy, and then detects and measures the employing an automatic data fusion algorithm (procc- 
cchoes returned from reflecting objects. The radar com- dure), which correctly and efficiently combines data 
puter processes the radar measurements and uses them generated by the ownship sensors into a global (central) 
to maintain a collection of radar "tracks", where each track file. When individual sensor track files are main- 
such track estimates the position, velocity and other tained for each sensor, the multi-sensor integration typi- 
attributes of a target, enabling the prediction of the c*lly involves a track-to-track association process 
target's position. A radar system typically provides which provides links (associations) between the sensor 
target range, azimuth, range rate, and azimuth rate in- tracks potentially representing the same targets, and 
formation for each radar track. Some radars have 25 °^ associated tracks, 

height finding capability, in which case their radar Any multi-sensor track-to-track association employs 
tracks also include elevation information. an assignment scheme between the members of the 

In many military applications, such as ship self- different track files that it operates on. As an example, a 
defense systems, other types of sensors, including IR radar/ESM track association operates on a radar track 
sensors and ESM sensors, may also be used in addition 3Q file and an ESM track file, and may assign a radar track 
to radar to enhance the detection and tracking of targets to each ESM track, if certain association criteria arc 
and to support the designation of targets to weapon met. Such an assignment scheme, operating on two 
systems. track files, is 2-dimensional. To determine the associa- 

An infrared sensor system detects infrared radiation. tions between a set of radar tracks and a set of ESM 
Such a sensor system uses radiation emitted by targets 35 tracks means to establish a set of rules assigning the 
to detect and track targets. An IR track includes azi- radar tracks to ESM tracks or the ESM tracks to radar 
muth and elevation data, but no range data. tracks. The assignments could be one-to-one (when 

An ESM sensor system detects radio frequency en- each radar track may only be linked to at most one ESM 
ergy. Such a sensor system includes a radio frequency track and each ESM track may only be linked to at most 
receiver detecting and monitoring electromagnetic 40 one radar track) or many-to-one (e.g., when a radar 
emissions from targets, and a processor estimating the track may be linked to more than one ESM track), 
waveform parameters, the anglc-of-arrival, and the In case of a radar/IR/ESM track association, its 
identification of the received signals. An ESM track assignment scheme operates on three track files: the 
typically provides bearing (angle-of<arrival), identifica- radar track file, the IR track file and the ESM track file, 
tion and waveform information, but does not include 45 Such an assignment scheme, operating on three track 
range or elevation information. files, is 3-dimcnsional. Ideally, for each target which 

The integration of collocated multiple sensors is generates a track in each one of the three track files, 
needed in ownship point defense applications for many those tracks should be associated to each other. When a 
reasons. The ownship multi-sensor integration enhances tri-sensor track association procedure is based on first 
the target acquisition and tracking performance. A tar- 50 making 2-dimensional assignments (i.e., pairwise associ- 
get undetectable by the ownship radar due to its small ations), conflicts and ambiguities may arise when the 
cross section or its position in the radar*s multipath nulls final 3-dimensional assignments (which we call global 
may be detected and tracked by the ownship IR sensor, associations) are made. To illustrate such a conflict, an 
or, in the presence of radio frequency emissions from IR track and an ESM track may have pairwise links to 
the target, by the ownship ESM sensor. A track undc- 55 the same radar track but not to each other. A new 3- 
tectable by the ownship IR sensor due to unfavorable dimensional assignment method which resolves such 
atmospheric conditions may be detected and tracked by conflicts and ambiguities is the subject of this invention, 
the ownship radar and ESM sensor. A track undetect- The following references are related to the subject 
able by the ownship ESM sensor due to the lack of matter of this invention and are described below: 
radio frequency emissions may be detected and tracked 60 [1] J- W. Thomas, A Radar-ESM Correlation Ois- 
by the ownship radar and IR sensor. The ownship radar criminant Using Bearing History, JHU/APL Re- 

estimate of a target's position and identification may be port F3A-7 9-2-08 5, March 1979. 

significantly improved when that target is tracked by all [2] G. V. Trunk and J. D. Wilson, Association of DF 
sensors and the multi-sensor integration is performed. Bearing Measurements with Radar Tracks, IEEE 

The improvement in that case is a result of using the 65 Transactions on Aerospace and Electronic Sys- 
more accurate target azimuth and elevation included in tems. Vol. AES-23, No. 4, July 1987, pp. 438-447. 

the IR track, and the more accurate target identification [3] C. L. Morefield and C. M. Peterson, Data Associ- 
included in its ESM track. ation Algorithms for Large Area Surveillance, 
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ORSA/TIMS Meeting. ORINCON Corp., May, 
1978. U Jolla. Calif. 1978, DTIC AD-A086606/1. 

[4] C. B. Chang and L. C Youens, Measurement 
Correlation For Multiple Sensor Tracking in a 
Dense Target Environment, Technical Report 549, 5 
Lincoln Laboratory, MIT, Lexington, Mass., Jan. 
20, 1981, DTIC AD-A09800L 

[5] C. L. Bowman and M. Gross, Multi-Sensor Multi- 
Platform Track Association Algorithm Using Kin- 
ematics and Attributes, IEEE National Aerospace 10 
and Electronics Conference, Dayton, May 2C>-24, 

1985, vol. 1, pp. 204-208. 

[6] S. S. Blackman, Multiple-Target Tracking with 
Radar Applications, Artech House, Norwood, 
Mass., 1986, pp. 363-367. 15 

[7] E. Davis, The Mission Avionics Sensor Synergism 
(MASS) Program, Proceedings of the 1987 Tri- 
Servicc Data Fusion Symposium, 9-11 June 1987, 
JHU/APL, Laurel, MD. Published by NADC, 
Warminster. Pa. 1987, pp. 366-372. 20 

[8] W. R. Ditzler, D. W. Cowan, A. G. Sutton and E. 
Benites, Integrated Multisensor Tracking, Pro- 
ceedings of the U.S. DoD Tri-Service Combat 
Identification Systems Conference, Arlington, Va. 

1986. 25 
[9] E. Benites, P. R. Decker, W. R. Ditzler and A. G. 

Sutton, A Demonstration of Multisensor Tracking, 
Proceedings of the 1987 Tri-Scrvice Data Fusion 
Symposium, 9-11 June 1987, JHU/APL, Laurel, 
MD, Published by NADC, Warminster. Pa., 1987, 30 
pp. 303-311. 

Radar/ESM track association algorithms have been 
known for some time [1] and continue to be the subject 
of research [2]. Algorithms are known which allow 
multiple ESM tracks to link with a single radar track 35 
but not vice versa, keep positional association (PA) lists 
of candidate radar tracks for association with each ESM 
track based on historical azimuth proximity, form links 
only when high confidence associations are obtained, 
and resolve ambiguities based on a sequential probabil- 40 
ity ratio test. The algorithm described in [1] . keeps a 
running bearing difference history for each candidate 
track pair, and uses it, as a fine discriminant, to resolve 
association ambiguities, allowing one-to-one associa- 
tions only. The logic proposed in [2] allows multi-links 45 
and uses a multiple hypothesis testing method based on 
the chi-squared distributed observed squared error in 
bearing. 

One association algorithm, designed to integrate a 
radar system and an ESM system in support of a missile 50 
system homing on target radio frequency emissions, 
uses PA lists, allows multi-links reflecting different 
sensor resolution capabilities, employs a running time 
average absolute value bearing difference history for 
fine discrimination, and makes immediate association 55 
decisions for all ESM tracks when they receive updates, 
and periodically each radar scan. 

References [3-9] describe multi-sensor track associa- 
tion algorithms which could integrate three or more 
sensors. The logic proposed in [6], and the logics [5] and 60 
[7-9], axe based on sequentially pairwise associations 
involving 2-dimensional assignment logics, and fusion 
of tracks into central level tracks. Such logics may not 
detect global conflicts or ambiguities and are likely to 
propagate association errors. The algorithm described 65 
in [8] and [9] is a modification of [7] which employs a 
one-to-one assignment logic, a clustering and centroid- 
ing logic, and a splitting and merging logic to account 



for the different resolution capabilities of the radar and 
IR sensor. The computational complexity of such an 
algorithm could be prohibitive in applications using 
limited data processing capabilities. Reference [3] 
shows that the association problem is an assignment 
problem, notes that no efficient method for finding the 
optima] solution to the multi-dimensional (i.e., of dimen- 
sion at least 3) assignment problem is known, and pro- 
poses a suboptimal solution recommended for low den- 
sity environments, and allowing multi-links. The multi- 
link structure thus obtained may not be consistent with' 
the specific target resolution capabilities of the different 
sensors. The association algorithm proposed in [4] is 
based on using Kalman filter residuals as measures of 
track similarity and reducing the one-to-one multi- 
dimensional assignment problem to a 0-1 integer pro- 
gramming problem. The run time of the integer pro- 
gram is shown, however, to grow exponentially with 
the number of potential correlations. 

SUMMARY OF THE INVENTION 

A new tri-sensor track association method is dis- 
closed, which operates on ranked dissimilar sensor track 
candidate pairs and measures of their proximity, and 
allows multi-links (i.e., multiple associations) reflecting 
different sensor target resolution capabilities. The track 
association involves an original 3-dimensional assign- 
ment scheme, is simple enough to be implemented in 
real-time, preserves the most pairwise links (highest 
ranked pairs), requires at least two pairwise links for 
any tri-sensor global track association, and minimizes 
the time average statistical bearing displacement be- 
tween associated tracks. 

A tri-sensor track assignment system in accordance 
with the invention is particularly useful in automatically 
integrating the track files of collocated radar, infrared 
(IR) and electronic support measures (ESM) sensors, 
when conflicts or ambiguities resulting from indepen- 
dently processed pairwise associations (e.g., situation 
where two dissimilar sensor tracks are linked with the 
same third sensor track but are not linked to each other) 
must be resolved in order to generate a non-redundant 
and consistent list of multi-sensor global track associa- 
tions. 

The use of the tri-sensor association for resolving 
global conflicts resulting from pairwise links has the 
advantage of generating a realistic multi-link structure 
reflecting the different sensor target resolution capabili- 
ties, while preserving most of the pairwise links. At the 
same time the system is simple enough to allow real- 
time implementation. 

A 3-dimensional track assignment system in accor- 
dance with the invention may be employed as a building 
block of a tri-sensor integration system which first 
forms ranked candidate pairs and performs 2-<limen- 
sional assignments (pairwise associations) and then re- 
solves global conflicts and makes the final 3-dimen- 
sional assignments. Such an integration approach has 
the advantage of a modular structure assuring adequate 
performance in case of sensor degradation. It also re- 
quires less processing than other multi-sensor track 
association sOgorithms because it does not require com- 
bining the associated tracks into fused global tracks. 
Another feature of the algorithm which adds simplicity, 
quick response to sensor updates and implementation 
convenience, is the local nature of the global association 
processing, as described herein below. 
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. ««^T^o *11 pairwisc-linked to each other, forming what we call 
BRIEF DESCRIPTION OF THE DRAWINGS ^ ..^^^^^ This case is depicted in FIG. la, where 

These and other features and advantages of the pres- the radar track R, the IR track I and the ESM track E 
ent invention will become more apparent from the fol- are represented by small circles, and the pairwise links 
lowing detailed description of an exemplary embodi- 5 between these tracks are represented by solid lines, 
ment thereof, as illustrated in the accompanying draw- Conflicts and ambiguities may arise when one of the 
ings, in which: pairwise associations between the three tracks de- 

FIG, 1 is a simplified block diagram of a Radar/IR- scribed in FIG. 2a is missing, so that the three tracks 
/ESM track association system embodying the inven- involved form what we call an open triad. To illustrate 
tion. 10 such a case, consider an ESM track E and a radar track 

FIGS. 7a^ illustrate various examples of pairwise R pairwise-linked to the same IR track I but not pair- 
associations which could be generated by the Pairwise wise-linked to each other. Since tracks R and E are not 
Track Association Processor of FIG. 1. pairwisc-linked to each other, one cannot conclude 

FIGS. 3fl-J illustrate an exemplary detailed flow without further processing whether these 2 tracks rep- 
diagram of the global association function performed in IS resent the same target or not. If tracks R and £ are not 
accordance by the Global Radar/IR/ESM Track Asso- even candidates for pairwise association O-c-i the deci- 
dation processor of the system of FIG. 1. sion not to pairwisc-associate tracks R and E was made 

FIGS. 4fl-m illustrate the types of global associations with high confidence) as illustrated in FIG. 2b, then 
which could be generated by the Global Radar/IR- tracks R and E should not represent the same target. If 
/ESM Track Association Processor of FIG. 1. 20 track E is also pairwise linked to another radar track, 

T^^^ * TT T^^^^B TTvT-T^vT i-^T^ TOT- Sdy Rj, as illustratcd in FIG. 2c, the case becomes also 

^^I^^«PJS^^l?I^^Tw2rj^ ambiguous, since track E could represent the same tar- 

PREFERRED EMBODIMENT get as track R, or the same track as track Ri. Ifthetrack 

A simplified block diagram of a tri-scnsor track asso- E is pairwise-associated to IR track Ii and radar track 
ciation system employing the invention is shown in 25 R2, and track E is a candidate for pairwise association 
FIG. 1. The system includes a radar system generally with radar track Ri and IR track I2 (the candidate pair- 
indicated as element 20, an IR system generally indi- wise links are represented by dotted lines in our figures), 
cated as element 30, and an ESM system generally indi- as illustrated in FIG. 2d, the situation is ambiguous since 
cated as element 40. The radar system 20 outputs radar either track E represents the same target as tracks Ri 
tracks. The IR System 30 outputs IR tracks. The ESM 30 and Ii, or the same target as tracks R2 and I2. 
System 40 outputs ESM tracks. The design goal of the Global Radar/IR/ESM Track 

Each of the sensors 20, 30 and 40 is well known in the Association is to process conflicts and ambiguities by 
art. The particular form ofeach such sensor is perse not generating global associations (where global associa- 
a part of the present invention. Accordingly the sensors tions represent final association decisions), so that most 
are not described in detail herein. 33 pairwise links become global links. In particular, the 

The pairwise association processor 50 processes the goal for processing open triads was set to generate 
radar tracks, the IR tracks and the ESM tracks as input global closed triads based on at least two pairwise links, 
track data, and provides pairwise associations, ranked and such that all global links are at least candidates for 
candidate track pairs and measures of their proximity as pairwise links (i.e., all the track pairs involve members 
output data. These data are then used as input data for 40 of pairwise association candidate lists). 

Z f^^^^ZJ\^Z^^;n7^t'^T- OlobalRadar/IR/ESMTraokAssociationD^cHption 
ferred embodiment, the processor 100 comprises a digi- The subject of this invention is the Global Radar/IR- 

tal computer programmed to perform the functions /ESM Track Association. In the association system 

herein below described. 45 described in FIG. 1, the global association is performed 

The formation and updating of pairwise track associ- by the processor 100. Its inputs, outputs, and the global 

ations and candidate track pairs ranked by measures of association processing performed by it are described 

their proximity, as performed by processor 50, is al- herein below. 

ready known in the art, as described above in the Back- Inputs. The following inputs are needed for the 

ground of the Invention. 50 Radar/IR/ESM Global Association Processor. Such 

The preferred embodiment of the invention is for a inputs are known in the art. 
ship self-defense application. Such an application is Each IR track has a "radar/IR (R/I) positional asso- 

morc particularly described in "Automatic Radar/IR- ciation" (PA) list and an "R/1 association candidate 

/ESM Track Association with Application to Ship Self list" (ACL), consisting of radar tracks which are candi- 

Defense", John T. Fagarasan and Ronald J. Jakaub, 55 date for association with the given IR track. The R/I 

Proceedings of the 1989 Tri-Service Dato Fusion Sym- ACL is a subset of the R/I PA list. For each radar track 

posium, Vol. I, pp. 277-286. The entire contents of this in such an R/I PA list, a figure of merit measuring the 

paper are incorporated herein by this reference. radar track's angular proximity to the IR track is avail- 

. able. This figure of merit may be used for comparisons 

Global Association Design Goals ^ between different pairwise associations. In the preferred 

The objective of the Global Radar/IR/ESM Track embodiment this figure of merit is the time average 

Association is to resolve ambiguities and conflicts squared normalized bearing difference between the 

which may arise due to track inaccuracies when pair- radar and the IR track, and is called the "R/I bearing 

wise associations arc performed as a first step of a history" of the radar/IR candidate track pair. For each 

Radar/IR/ESM Track Association process. 65 radar track in an IR track's R/I ACL, a figure of merit 

In a case free of ambiguities and conflicts, when a used to rank the ACL is available. In the preferred 

target is tracked by all three sensors, the radar track, the embodiment this figure of merit is called the "R/I dis- 

IR track and the ESM track representing that target are crepancy" of the radar/IR candidate track pair and is 



02/06/2004, EAST Version: 1.4.1 



5,317,319 



calculated as the sum of the bearing history and other 
figures of merit (an R/I heading figure of merit which 
penalizes track pairs with conflicting inbound/out- 
bound information, an identification figure of merit 
which penalizes track pairs with conflicting identifica- S 
tion information, and a high confidence link hysteresis 
figure of merit which penalizes track pairs which have 
not been linked with high confidence). The smallest 
discrepancy yields the highest rank. Each IR trade is 
pairwise-linked (i.e., pairwise-associated) to the highest 10 
ranked radar track in its R/I ACL, if any. 

Each ESM track has a "radar/ESM (R/£) positional 
association*' (PA) list and an "R/E association candi- 
date list (ACL)'\ consisting of radar tracks which are 
candidate for association with the given ESM track. 15 
The R/E ACL is a subset of the R/E PA list. For each 
radar track in such an R/E PA list, a figure of merit 
measuring the radar track's angular proximity to the 
ESM track is available. This figure of merit may be used 
for comparisons between different pairwise associa- 20 
tions. In the preferred embodiment this figure of merit is 
the time average squared normalized bearing difference 
between the radar and the ESM track, and is called the 
"R/E bearing history" of the radar/ESM candidate 
track pair. For each radar track in an ESM track's R/E 25 
ACL, a figure of merit used to rank the ACL is avail- 
able. In the preferred embodiment this figure of merit is 
called the "R/E discrepancy" of the radar/ESM candi- 
date track pair and is calculated as the sum of the bear- 
ing history and other figures of merit (an R/E heading 30 
figure of merit which penalizes pairs of ESM missile 
tracks and radar tracks with large crossing angles, an 
identification figure of merit which penalizes track pairs 
with conflicting identification information, and a high 
confidence link hysteresis figure of merit which penal- 35 
izes track pairs which have not been linked with high 
confidence). The smallest discrepancy yields the high- 
est rank, fiiach ESM track is pairwise-linked (i.e., pair- 
wise-associated) to the highest ranked radar track in its 
R/E ACL, if any. 40 

Each ESM track has an "IR/ESM (I/E) positional 
association" (PA) list and an "I/E association candidate 
list" (ACL), consisting of IR tracks which arc candidate 
for association with the given ESM track. The I/E 
ACL is a subset of the I/£ PA list For each radar track 45 
in such an I/E PA list, a figure of merit measuring the 
IR track's angular proximity to the ESM track is avail- 
able. This figure of merit may be used for comparisons 
between different pairwise associations. In the preferred 
embodiment this figure of merit is the time average 50 
squared normalized bearing difference between the IR 
and the ESM track, and is called the "I/E bearing his- 
tory" of the IR/ESM candidate track pair. For each IR 
track in an ESM track's I/E ACL, a figure of merit used 
to rank the ACL is available. In the preferred embodi- 55 
ment this figure of merit is called the "I/E discrepancy" 
of the IR/ESM candidate track pair and is calculated as 
the sum of the bearing history and other figures of merit 
(an I/E heading figure of merit which penalizes track 
pairs with conflicting inbound/outbound information, 60 
an identification figure of merit which penalizes track 
pairs with conflicting identification information, an 
elevation figure of merit which penalizes track pairs 
with conflicting elevation information, and a high confi- 
dence link hysteresis figure of merit which penalizes 65 
track pairs which have not been linked with high confi- 
dence). The smallest discrepancy yields the highest 
rank. Each ESM track is pairwise-linked (ie., pairwise- 
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associated) to the highest ranked IR Uack in its I/E 
ACU if any. 

Definitions. The following terminology is used be- 
low. "Link", "linked" mean pairwise-link, pairwise- 
linked, respectively. If a radar track R has IR links, then 
R together with all the IR tracks linked to it is called a 
"strong global track germ" (strong GTG). A radar 
track with no IR track links is called a "weak radar 
GTG". An IR track with no radar track links is called 
a "weak IR GTG". The radar track of a strong GTG or 
a weak radar GTG is called the "leader" of that GTG, 
The IR track of a weak IR GTG is called the "leader" 
of that GTG. 

A strong GTG with leader R is said to be "eligible for 
global association" with an ESM track £ if either 1) E 
is linked with R and at least one IR track in GTG is in 
the I/E ACL of E, or 2) £ is linked with at least one IR 
track in GTG and R is in the R/E ACL of E. We defme 
the "bearing displacement" BD between E and a strong 
GTG eligible for global association with E as: 

BD(E,GTG)-BH(R.E)+imu/{BH(R,I)-hBH(I,E)) 

where the minimum is taken over all IR tracks I linked 
with R and contained in E's I/E ACL, and BH means 
bearing history. 

A weak radar GTG is said to be "eligible for global 
association" with an ESM track E if the leader of the 
GTG is in E's R/E ACL. A weak IR GTG is said to be 
"eligible for global assodation" with an ESM track E if 
the leader of the GTG is in E's I/E ACL. The weak 
radar GTG with track of smallest R/E discrepancy 
among all weak radar GTG's eligible for association 
with E, if any, is the "best choice weak radar GTG" for 
association with E. The weak IR GTG with track of 
smallest I/E discrepancy among all weak IR GTG's 
eligible for association with E, if any, is the "best choice 
weak IR GTG" for association with E. 

Global Association. Each ESM track E is processed 
for global association as follows. 

1. A search is performed to fmd the strong GTG's 
eligible for global association with track £. If any 
such GTG is found, then E is "globally associated" 
with the strong GTG eligible for association with 
E which has the smallest bearing displacement BD 
from £. If no such GTG is found, the following 
processing is performed. 

2. A search is performed to fmd the weak radar 
GTG's and the weak IR GTG's eligible for global 
association with E. If any such GTG is found, then 
E is "globally associated" to cither the weak radar 
.GTG eligible for association with £ which has the 
smallest R/E discrepancy from £, or to the weak 
IR GTG eligible for association with E which has 
the smallest I/E discrepancy from E. whichever 
has the leader track with the smallest bearing his- 
tory from track £. If no such weak GTG b found, 
the following processing is performed. 

3. Track £ is declared not globally linked to any 
other tracks. 

The global associations are established after track 
initiation and reestablished periodically each radar scan. 

Outputs. For each ESM track, the output of the 
Global Radar/IR/£SM Track Association Processor 
100 of FIG. 1 is the global association status of the said 
ESM track, including its global associations Qinks) to 
radar and IR tracks, if any. 
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Exemplary Implementation of Global Association 

FIGS. 3a-</ illustrate an exemplary detailed flow 
diagram of a searching procedure yielding the eligible 
GTG's for association with any given ESM track, and 
the assignment method implementing the global associ- 
ation process according to the invention. The following 
terminology and acronyms are used in the drawings. 
"Linked" means pairwise-associated, "globally linked" 



ESM track E is linked to an IR track II which is linked 
to a radar track R2 which is not in £*s R/E ACL, and 
ESM track E has at least an IR track without radar links 
in its I/E ACL, then the weak IR GTG flag WI is set 
equal to 1, the IR track of smallest discrepancy among 
the IR tracks with no radar links in E's I/E ACL is 
denoted by Iw, and the operation proceeds to node B. 

Referring to FIG. 3c, the processing for node 6 is as 
follows. If (230) E's GACLri is empty, i.e.» there is no 



means globally associated, I/E=:IR/ESM, R/£=- 10 strong GTG eligible for association with ESM track £, 

ladar/ESMi ACL^Pairwise Association Candidate then the operation proceeds to node C. If (240) E*s 

List, GACLri = Global Association Candidate List of GACLri is not empty and the number of radar tracks in 

radar tracks with IR links, BH=bearing history. The it is not two (i.e., there is exactly one strong GTG's 

flow diagram is described herein below. eligible for association with E), then (245) track £ is 

Referring to FIG. 3a, the described processing is 15 declared globally linked to the radar track R in E*s 

perfonned for any given ESM track E (105). First (110), strong GTG eligible for association with E, and to all 

the weak radar GTG flag WR and the weak IR GTG IR tracks linked to R, and the operation is terminated. If 

flag WI are both set equal to zero. If the ESM track E E's GACLri is not empty and the number of radar 

is not linked (pairwise associated) to any radar track Rl tracks in it is exactly two (i.e., there are exactly two 

(115), the operation proceeds to node A. If the ESM 20 strong GTG's eligible for association with E), and the 

track £ is linked to a radar track Rl which is not linked radar Uacks in those GTG*s are Rl and R2 respectively! 

to any IR tracks, the weak radar GTG flag WR is set the bearing displacements dl and d2 of the two GTG's 

equal to 1, the radar track Rl is denoted by Rw (125), are calculated as described in 250. If (260) dl^d2, then 

and the operation proceeds to node A. If the ESM track (261) track £ is declared globally linked to the radar 

£ is linked to a radar track Rl which has IR links, and 25 track Rl, and to all IR tracks linked to Rl, and the 

at least one IR track linked to Rl is also linked to the operation is terminated. If dl>d2, then (262) track E is 

ESM track £ (130), then the ESM track £ is declared declared globally linked to the radar track R2, and to all 

globally linked to the radar track Rl and all the IR IR tracks linked to R2, and the operation is terminated, 

tracks linked to Rl, and the operation is terminated. If Referring to FIG. 3d, the processing for node C is as 

the ESM track £ is linked to a radar track Rl, which is 30 follows. If WR+ WI=0, then (275) track E is declared 

linked to one or more IR tracks, such that none of these not globally linked to any other tracks and the opera- 

IR tracks is linked to the ESM track E (140) but at least tion is terminated. If WR+ WI>0 and (280) WR=0, 

one of them is in E's I/E ACL. then the GTG formed track E is declared globally linked to the IR track Iw 

by radar track Rl and all IR tracks linked to it is de- and the operation is terminated. If WR-|-WI>0 and 

clared eligible for global association with £, the radar 35 (295) WI=0, track E is declared globally linked to the 

track Rl is entered in £*s Global Association Candidate radar track Rw and the operation is terminated. If 

List of radar tracks with IR links (GACLri) (145), and WR>0, WI>0, and (300) the bearing history between 

the operation proceeds to node A. If the ESM track E £ and the IR track Iw is smaller than the bearing history 

is linked to a radar track Rl which is linked to one or between E and the radar track Rw, then (305) track £ is 

more IR tracks, such that none of these IR tracks is in 40 declared globally linked to the IR track Iw and the 

E's I/E ACL (150), and there are no radar tracks with- operation is terminated. If WR>0, WI>0, and (400) 

out IR links in E's R/E ACL, then the operation pro- the bearing history between E and the IR track Iw is 

ceeds to node A. If the ESM track £ is linked to a radar not smaller than the bearing history between £ and the 

track Rl which is linked to one or more IR tracks, such radar track Rw, then track £ is declared globally linked 

that none of these IR tracks is in E's I/E ACL, and 45 to the radar track Rw and the operation is terminated. 



ESM track £ has at least a radar track without IR links 
in ite R/E ACL. then the weak radar GTG flag WR is 
set equal to 1. the radar track of smallest discrepancy 
among the radar tracks with no IR links in E's R/E 



What is claimed is: 
1. A method for performing global association pro- 
cessing of the respective radar, infrared (IR) and elec- 
tronic support measures (ESM) tracks from a tri-sensor 



ACL is denoted by Rw, and the operation proceeds to 50 system providing such radar, IR and ESM tracks, and 



node A. 

Referring to FIG. 3d, the processing for node A is as 
follows. If the ESM track £ is not linked to any IR 
track (170), the operation proceeds to node B. If the 



wherein the sensor system provides (i) for each IR 
track, a radar/IR (R/I) positional association (PA) list 
and an association candidate list (ACL) subset of the 
PA list, the PA list consisting of radar tracks each hav- 



ESM track £ is linked to an IR track II (180) which is 55 ing an R/I bearing history figure of merit measuring the 



not linked to any radar track, the weak IR GTG flag 
WI is set equal to 1, the IR track II is denoted by Iw 
(185), and the operation proceeds to node B. If the ESM 
track £ is linked to an IR track U which is linked to a 



radar track's historical angular proximity to the IR 
track, the ACL ranked by an R/I discrepancy flgure of 
merit, with the smallest discrepancy yielding the high- 
est rank, wherein each IR track is linked to the highest 



radar track R2 (190), and R2 is in E's R/E ACL, then 60 ranked radar track in its R/I ACL, (ti) for each ESM 



the GTG formed by radar track R2 and all IR tracks 
linked to it is declared eUgible for global association 
with £, the radar track R2 is entered in E's GACLri) 
(195), and the operation proceeds to node B. If the ESM 



track, a radar/ESM (R/E) positional association (PA) 
list and an association candidate list (ACL) subset of the 
PA list, the PA list consisting of radar tracks each hav- 
ing an R/E bearing history flgure of merit measuring 



track £ is linked to an IR track U which is linked to a 65 the radar track's historical angular proximity to the 



radar track R2 which is not in E's R/E ACL (200), and 
there are no IR tracks without radar links in E's I/E 
ACL, then the operation proceeds to node B. If the 



ESM track, the ACL ranked by an R/E discrepancy 
flgure of merit, with the smallest discrepancy yielding 
the highest rank, wherein each ESM track is linked to 
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the highest ranked radar track in its R/E ACL, and (iii) 
for each ESM track, an IR/ESM (I/E) positional asso- 
ciation (PA) list and an association candidate list (ACL) 
subset of the PA list, the PA list consisting of radar 
tracks each having an I/E bearing history figure of 5 
merit measuring the IR track's historical angular prox- 
imity to the ESM track, the ACL ranked by an R/I 
discrepancy figure of merit, with the smallest discrep- 
ancy yielding the highest rank, wherein each ESM 
track is linked to the highest ranked IR track in its I/E 10 
ACL, the method including the steps of: 

(a) for each radar track R having IR track links, form- 
ing a strong global track germ (GTG) consisting of 
the radar track R and all IR tracks linked to it; 

(b) for each radar track with no IR tracks linked to it, IS 
forming a weak radar GTG consisting of that radar 
track; 

(c) for each IR track with no radar track linked to it, 
forming a weak IR GTG consisting of that IR 
track; 20 

(d) for each ESM track defining a list of strong 
GTG*s eligible for association with that ESM 
track; 

(e) for each ESM track defining a list of weak GTG's 
eligible for association with that ESM track; 25 

(f) globally associating each ESM track with the 
eligible strong GTG of smallest bearing displace- 
ment from the ESM track, if any; 

(g) if no strong GTG is eligible of association with a 
particular ESM track, globally associating that 30 
ESM track with the best choice weak GTG, if any; 
and 

(h) for each ESM track which does not associate with 
any GTG, declaring that ESM track not globally 
associated with any other tracks. 35 

2, The method of claim 1 wherein a strong GTG is 
declared eligible for association with the ESM track if 
and only if either (1) the ESM track is linked with the 
radar track R in said GTG and at least one IR track in 

40 



said GTG is in the I/E ACL of the ESM track, or (2) 
the ESM track is linked with one IR track in said GTG 
and the radar track R in said GTG is in the R/E ACL 
of the ESM track. 

3. The method of claim 1 wherein a weak radar GTG 
is declared eligible for association with an ESM track E 
if and only if the radar track in said weak GTG is in the 
track E's R/E ACL. 

4. The method of claim 1 wherein the best choice 
weak radar global track germ is defined as that weak 
radar GTG with the radar track of the smallest R/E 
discrepancy among all weak radar GTG's eligible for 
association with the ESM track, if any. 

5. The method of claim 1 wherein a weak IR global 
track germ is declared eligible for association with an 
ESM track E if and only if the IR track in said weak 
GTG is in the track E's I/E ACL. 

6. The method of claim 1 wherein the best choice 
weak IR GTG is defined as that weak IR GTG with the 
track of the smallest I/E discrepancy among all weak 
IR GTG*s eligible for association with the ESM track, 
if any. 

7. The method of claim 1 wherein the best choice 
weak GTG is defined as the best choice weak radar 
GTG or the best choice IR GTG, whichever has the 
smallest bearing history from the ESM track. 

8. The method of claim 1 wherein the bearing dis- 
placement BD between an ESM track E and a strong 
GTG eligible for association with the track E is defined 
by the relationship: 

BD(E,GTG)-BH(R,E)-|-iiiin/{BH(ft,I)+BHa,E)} 

where R is the radar track of the said GTG, the mini- 
mum is taken over all IR tracks I linked with R and 
contained in E's I/E ACL, and BH means bearing his- 
tory. 
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